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Ab8.tjja_ct The question of the existence and the loci'tlon of Durhoux 
points (beyond which global optimality is lost) is crucial for minimal 
sufficient conditions for global optimality and for computation of optimal 
trajectories. Here, we numerically inve.st igate the Darboux points and their 
relationship with conjugate points for a problem of minimum fuel, constant 
velocity, hori^rontnl aircraft turns to capture a line. This simple second- 
order optimal control problem shows that ignoring the possible existence ot 
Darboux points mav plav havoc with the computation of optimal trajectories. 
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1. Introduction 


Opt lnk»l controls and optiwal state trajectoriss are often Invest Igatod by 
eom|Hitat Ion ol extrera^ila, I.e., state tralectorles satisfying tl»e necessary 
conditions oi the minimum principle. Thus, rather than solve a two-polnt- 
boundarv-value problem, one integrates, for example, the state and costate 
differential equations from a given end state, with the end conditions v'n the 
costatea as parameters. Wlten the equation.^ are integrated over a sufficiently 
long interval, local and global optimality of the extremals may unwittingly 
be lost, i.e., the integration crosses conjugate and Parboux points. 

(.Conjugate and Darhoux points are defined as time points on the time Interval 
of interest, but u.suallv also refer to the states on the extremal correspond- 
ing to these times.) 

A point conjugate to an end point is one beyond which an extremal is no 
longer locally optimal hence its obvious importance; an earl'» reierenee is 
[1], and a recent one is (2]. Yet, not all the results on conjiigato points 
in the calculus of variations have been translated into the control context, 
particularly tor bounded controls. I’hc books bv Hestenes (3) and Young Is], 
tor Instance, stop short ol conjugate points in their discussion of optimal 
control theory. In pr.-rctice, conjugate points are rarely tested for (how- 
ever, see !'>], [b], I7j); in fact, they are often simply ignored. 

A Parhoux point to an end point Is one beyond which the extremal is no 
longer globally optimal [8]. A Darboux point often precedes a conjugate 
point, a tact apparently first recogni?.ed bv Parboux [d], llO]; hcncc the 
name Parboux point assigned bv Mover and Kellv In (‘i]. There arc no g<MU>jal 
tests tor Parboux points, oxcept tor tlic case ol »|uaJratic portornunce Intt' 
o.ra!>i with aonlincar terminal ten.s. subject to iincai dii ioient ial I'oua! ions 
atu! nonlinear end state ceustialnts (11 i. 


W(* t*m*ounterecl the vfxlng Darboux point phenomenon in our study of 
minimum fuel landing approacher (to be published). Our objective here is to 
compute the extremals and to find the conjugate and Darboux points for .» second- 
order special case to gain insight on their locations and their relationship. 


II . The Example 

We explore the question of Darboux point.s for a particular second-order 
example which derives from the problem of horizontal minimum-fuel aircraft 
turns to capture a line, such as would occur during a landing approach. To 
stay within the simplifying realm of two state variables we assume constant 
velocity and select the state variables xj and X£ to represent the heading 
angle and the distance to the line, respectively; the control variable u 
represents the tangent of the bank angle. Under certain assumptions and suit- 
able normalization the equations (see Appendix) are 

Xj » -u , xi(tj) * k2v , k » 0 , ±1 , (2.1) 

Xj “ sin xj , X 2 (tj) * 0 , (2.2) 

]ul < 1 . (2.3) 

The co.st integral is 


.1 




ii(l + c) 



(1 + cu^)dt , 


(2,4) 


where t. is free and c is a nonnegative, constant (J is normalized with 

I 

respect to the cost on an interval of length ir/2, with lu(t)| * 1, i.e., the 
cost of a 90® turn at maximum bank angle). 

We next compute f. ami lies of all extremals bv backward integration from 
tlu‘ i>rigiii, x(t^.) = (0, 0), plot curves of constant co.sC, and obtain of 

Darboux and conjugate points to the origin. The situation is complicated hy 
Che fact that states differing in the xj, component bv multiples of 2’ are 
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1 

.®j’ Thus, on an extremal to the orlRln, there may be points 

beyond which the extremal la no longer globally optimal because nonneighboring 

extremals to (k2Tr, 0) yield lower cost; we denote these points by D. , , k » 0, 

K» 

il,... . According to the definition in [8J, there can be only one Dnrboux 
point on an extremal; the first of the points ^he backward direc- 

tion. We will call the other points pseudo-Darboux points . Tlie concept of 
pseudo-Darboux point is applicable to other situations with a complicated set 
of end states. 

Insight may be gained by referring to the aircraft turning problem (see 
Appendix). The aircraft trajectories in the horizontal plane are easy to draw 
because they are comprised of circular arcs when juj "1 and nearly dcraight 
lines wtjen |u| »■ 0 (as in Fig. 7). It should be noted, however, that Che 
coordinates of the horizontal plane is not the state for this example; our 
analysis is in the x^ - X 2 state plane for Che problem stated in (2.1)-(2.4). 

III. Computation of Extremals 

The extremals are computed by application of the minimum principle [i]. 

The Hamiltonidn H and costates \q, Xj, and are given by 


H * Xq( 1 + cir') - Xiu + X 2 ^1 » (3.1) 
Xq 2 0 , Xo ’ const , (3.2) 
Xi * -X 2 cos xj^ , (3.3) 
At “ const . (3.4) 


We consider extremals with Xp ^ 0*; then, Xq can be set at Xo “ I. 

*In the abnormal case, Xg » 0, we have u •* sgn \i, u ^ 0, and 
Xi(tj.) * 0. This yields only two extremals, which are identical to the 
extremals for Xg » 1 and ■ ±'«\ 
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Minimljsacion of H with respect to yields, for c 

A . Mi 2c , 


0 , 




\l/.*c 


hil 


-2o 


Since tj. is unspecified, we have the condition 

lll^ - 1 + “ Xi(tj.)u(t^) * 0 


Sat is f vine, fi.'O and ti.h) vtclds 




I 1 , 0 ‘ C i; 1 , 

\l//c , C 2 1 , 


and 




(1 + c)sgn u(Lj) , 0 < r i 1 , 

i/e sgn ;(t£.) , c £ 1 . 


( }.S) 


U.h) 


0.7) 


Ci.B) 


It Is evident from Eqs. (2.1), (2,2), (3.3), (3.3), and (3.8) that the 
extremals depend on two parameters: the .sign of u(t|.) ^ and the value 

ot the constant \.'. Ihu.s, for a given c, we c.an group the extremals Into 
tour tamilie.s; 

in, ■ d , t - il I , i u U , \ . a U » , til • () , ^ (H , (u. >- ll , l O’- 

I t I * I • 

Of the.se, it Ls easv to see that the third and fourth famllie.s are sytrenetrlcal 
about the origin to the first and .second, respectively. The second farailv can 
al.so he obtained trv-m the first (as comparison of Figs. 2 and 3 will reveal). 

Figure 1 .show.s the first family of extremals together with curve.s of 
otmstant cost, .1 » const. The extremal for A;* ■ -1.0 asymptot icallv tend.s 
to the line xj "‘il. The extremals for ; \; j ' 1 are drawn onlv up to and 
slij'JuU bovond the ctuijug.ite point, i.e., the contact with the envelope to 


the family.^ Since the rettalnlng three fwailies with their associated curves 
of constant cost can easily be obtained from the first, Fig, 1 can be trans- 
ferred onto a transparent sheet to seek intersections of curves of constant 
cost of the first family with those of equal value of the other families [also 
of families of extremals to (2kff, 0; k " +1), no need to consider larger k'sj. 
In this example, these intersections determine the 

Figure 2 shows the first family of extremals and the D. - loci, 

K a 

k » 0, +1. Tile solid heavy curves are loci of Darboux points, the broken 
curve is the locus of pseudo-Darboux points, and the dash-dot curve is the 
locus of conjugate points. A few alternative equicost extremals from points 
on the D, ^ - loci are shown. Consider, for instance, the extremal corre- 
.spending to X 2 " -i.l, starting backwards from the origin. Beyond the point 
Do there exist lower cost extremals to the origin, of the fourth family; thus. 
Do is a Darboux point. B^*yond the point there are lower cost extremals 

to (“2it, 0), of the third family, but of higher cost than extremals of the 
fourth family to the origin. Thus, D , is a pseudo-Darboux point; the alter- 

•"tlT 

native equicost extremal from D to (-2ti, 0) is shown. Tlie contact point 
C with the envelope is a conjugate point to the origin beyond which the 
extremal in question is no longer locally optimal. Indeed, the cost from Che 
point 1’, which is bevond the envelope contact for the * -1.1 extremal, 
is J (-1-1) * 4.61, while for the neighboring \p “ -1.04 extremal it is 

p 

J (-1.04) * 4 . 57 . We note that from the state (-a, 0), the intersection of 
P 

the Do - locus and the 0_ - locus, there are four globally optimal 

"^We assume that the envelope theorem of the calculus of variations (e.g., [4)) 
holds here; then the envelope contact points are conjugate points. At. any 
rate, the subsequent discussion shows numerically that local optlraalitv is 
lost past tho contact p-.dnts. 
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extreraftls; two to the origin and two to ("Zr, 0). Wa also note that the Darboux 
and conjugate points coincide only on the abnormal extrmal, X 2 (see foot- 
note on p. 4). (For interpretation of Darboux points in terms of the aircraft 
trajectories in the horizontal plane, see Fig. 7 where the Xj - axis is the 
line to be captured.) 

Figure 3 shows the second family of extremals with details as in Fig. 2. 

Note that all the extremals coincide on the arc from (it, -2) to the origin 

(representing a final 180* turn at maximum bank angle). For I 2 - 1*04, the 

Darboux points are on the Dq - locus, (the segment {xtxi “ tt, -2 < X 2 < 0}), 

while for X 2 ^ 1.04 the Darboux points are on the D. - locus. The 

2tt 

extremals of this family are globally optimal only for Initial states 
restricted to the shaded area shown in the figure. 

Having obtained the loci of the Darboux points, we can determine a 
strip of width 2n in the state plane with all globally optimal trajactories 
to the origin, as shown in Fig. 4. The strip is symmetrical about the origin. 
Initial states outside this strip have globally optimal trajectories to 
(k2ir, 0), k “ ±1,...; however, they can be shifted by a multiple of 2tt to 
an equivalent initial state inside the strip. The globally optimal trajecto- 
ries are unique, except those from initial states on the segments 
{x:xi * n, -2 < X 2 i 0}, and {x;xx * -it, 0 < X 2 < 2}. All optimal trajecto- 
ries starting at initial states with X 2 < 0 end with “f “ except those 
in the vertically shaded area which end with u^ » -1. The optimal control 
is mostly |u(t)j -i; 1, except in the horizontally shaded areas where 
{u(t) I 1. 

Results are shown only for c = 0.1 (which corresponds to the fuel flow 
characteristics of a jet transport at sea level); the cases c * 1 and 
; *■ 10 were examined and seen tc qualitatively similar. We also examined 


the case c • 0, the tlaw optimal case, previously treated from a different 
perspective by Brzberger and iLee [12]. The resulting families of 'xtremals 
and D, ” loci ar® quite similar to those for c 0, but with cot'i. ir 'nd 
straight lines (caused by u switching between the values ±1, OK 

IV. Conclusions 

It is the crucial importance of Darboux points in computing globally 
optimal trajoe- >rles and the scarcity of results that motivated us to report 
in detail on a particular problem. We find that on some extremals the Darboux 
point Is a Dq point (e.g., on the extremal An « ~1.3 in Fig. 2) while on 
others the Darboux point is a ^2 " -1.0001 in Fig. 2) or 

a point (e.g., Aj “ -0.999 in Fig. 2). We observe in Figs. 2 and 3 

that only the Darboux points on the extremals for jA 2 l > 1, where u does 
\ liange sign, are followed by conjugate points. Therefore, it does not appear 
profitable in this example to search for the Darboux points by testing fi>r 
conjugate points. Also, on most extremals the conjugate point Is far behind 
the Darboux point. For example, for the extremal for An * 1.3 In Fig. 3, 
backwards from the origin, the conjugate point C occurs about SOX later than 
in the Darboux point Dq* 

As illustrated here, the question of the existence of Darboux points can- 
not be lightly dismissed nor easily answered. We hope to have stimulated an 
awareness of the problem and of the need for further research. 
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Appondlxt D«rivatian of Kqs, (2,l)-(2.A) 

The airplane is flying at ccnatant velocity v in the hori/iintnl x - v 
plane, with the heading angle # as shown in Fig. 5. Figure 6 •h'-v » e lift 
force L, the weight W and iha bank angle ^ which is constrained by 




max 


(Al) 


Neglecting the vertical component of the thrust T, we have the constraint 


L cos # * W . 

Assuming const int mass m, we have 

dti< , . . W sin i 

»v •it' “ “b sin ■ - -mg tan ^ 

dt cos ^ 

The equations of motion are therefore 


dt 

dt 

dx 

dt 


tan ^ , 

V 

* V sin ^ , 

• V cos ■ 


We use the nondiraensional time 

T » tv/R , 

where R is the (smallest) radius of turn for |!|>i * ^ 


max 


R 


v‘ 


lili 1 8 tan 

' max ' 


max 


Then (A3) becomes 



(A2) 


(A3) 


(A4) 


(A5) 


(A 6 ) 


where 


xi = , X 2 “ y/R , X 3 * x/R , u “ tan (ji/tan 4> 


max 


(A7) 
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and the dut represents d/dr. Hence Eqs. (2.1)-(2.3), where we denote the 
nond lawns ional tlsw by t. 

We assume that the fuel flow depends on the thrust according to 

Fuel Flow ■ cq cjT . (/ 

Assuming zero sideslip, constant velocity requires that thrust equal drag. 
The drag is assumed to be given by 

D " kjv^ + oLa , 

where and n are constants and a is the angle of attack. Assuming 


further that 


L - kv^o , 


%fhere k Is a constant, we have, using (A2), 

The fuel consumption Is therefore given by 

J tj 

{(co + cjkjv^ + Cik2/v^) + (cjk2/v^)tan^ ♦Jdt , 

Q 

where the terms in parentheses are constants. Hence the performance Integral 
for minimum fuel is of the form given in Eq. (2.4). 

In the optimal control problem of capturing the line y =* 0 with 
the state variable X3 ■ x/R in (A6) can be ignored; it is 
required, of course, for the flight trajectories in the horizontal plane. 

The plot of such trajectories is useful for the Ip.terpretatlon of Darboux 
points as shown in Fig. 7 which Illustrates ^.2,^ Darboux points. 

In the backward direction, the heavy-line trajectories are globally optimal 
up 'CO and including the points and Dg. From the points D and Dg 

there exist equicost alternative trajectories, while beyond these point.s 
there exist lower cost tra iectorievs , e.g., tho.se .shown In da.slied curve.s from 
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the points A. On the other hand, the conjugate point* are not unefuilv 
interpreted by horizontal flight trajectories. 


11 


References 


[1] J. V. Breakwell and Y. C. Ho, "On the conjugate point condition for the 
control probleM.'* Int. J. Eng. Sci .. vol. 2, pp. 565-570, 1965. 

[2] P. M. Mereau af.d'W. F. Powers, "Conjugate point properties for linear 
quadratic problems," J. Math. Anal. Appl . . vol. 55, pp. 418-433, 1976. 

[3] M. R. Hestenes, Calculus of Variations and Optimal Control Theory , 

New York: John Wiley & Sons, Inc., 1966. 

[4] L. C. Young, Lectures on the Calculus of Variations and Optimal Control 

Theory . Philadelphia, PA: Saunders, 1969. 

[5] H. G. Moyer and H. J. Kelley, "Conjugate Points on Extremal Rocket 
Paths," Proc. of the 19th Int. Astronautic;;! Congress, New York, 1968, 
vol. 2, pp. 163-172. Pergamon Press, London, 1970. 

[6] II. G. Moyei, "A computer survey of impulsive ellipse-ellipse transfer," 
AIAA J . . vol. 9, no. 2, pp. 321-323, 1971. 

[7] H. G. Moyer, "Optimal control problems that test for envelope contacts," 
.IOTA, vol. 6, no. 4, pp. 287-298, 1970. 

[8] P. M. Mereau and W. F. Powers, "The Darboux point," JOT A , vol. 17, 
nos. 5/6, pp. 545-559, 1975. 

[9] 0. Bolza, Vorlesungen Uber Varlationsrechnung , p. 438, Teubner, Leipzig, 
1909, reprinted by Chalsea Publ. Co., New York, 1963. 

[10] G. Darboux, Sur la Theorle des Surfaces , vol. Ill, p. 89, Gauthiers- 
Villars, Paris, 1894. 

[11] P. M. Mereau and W. F. Powers, "Characterization of the Darboux point 
for particular classes of problems," JOTA , vol. 22, no. 4, pp. 537-562, 
1977. 

[12] H. Erzbt-rger and H. Q. Lee, "Optimum horizontal guidance techniques for 
aircraft," J, Air craft , vol. 8, no. 2, pp. 95-101, 1971. 


12 


Figure Captions 


Fig. 1, Extremals and curves of constant cost for the ia.. ily 

{u^ ■ 1 , ^ » c * 0.1. 

Fig. 2. Family (u^ * 1 , X 2 ^ “ 0*1* loci of D-point: , and 

alternative equicost extremals. 

Fig. 3. Family {u^ “ 1 , Xg > 0} , c » 0.1, loci of D-points, and 

an alternative equicost extremal. 

Fig. A. Strip of width 2ir with globally optimal trajectories to origin. 
Fig. 5, Top view of aircraft in x - y plane. 

Fig. 6. Rear view of aircraft. 

Fig. 7. Illustration of Darboux points in the horizontal plane 
(a) A D Darboux point, (b) A Dq Darboux point. 
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